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^ ' Abstract 
^\ 

, Balas and Mazzola linearization (BML) is widely used in devising cutting plane algorithms 

for quadratic 0-1 programs. In this article, we improve BML by first strengthening the primal 
formulation of BML and then considering the dual formulation. Additionally, a new cutting 
plane algorithm is proposed. 
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lHj' 1 Introduction 

^ \ In this article, we consider the generalized quadratic 0-1 program given as follows 

0^ ' 

CN ' , . min x^Bx + c^x , , 

s.t. xGxc{o,ir, ^^-^^ 

■ where B = (bij) is an n x n nonnegative matrix. Without loss of generality we assume ba = 

. since baxf = buXi. Problem (P) is a generalization of unconstrained zero-one quadratic problems, 

zero-one quadratic knapsack problems, quadratic assignment problems and so on. It is a classical 
NP-hard problem [8]. 

^ ' Linearization strategies are to reformulate the zero-one quadratic programs as equivalent 

^ ■ mixed-integer programming problems with additional binary variables and/or continuous vari- 

- - - ables and continuous constraints, see O El [71 [9l [ini [HI E] • Recently, Sherali and Smith [16] 



developed small linearizations for more generalized quadratic 0-1 programs. Gueyea and Mich- 
elon [12] proposed a framework for unconstrained quadratic 0-1 programs. These linearizations 
are standard for employing exact algorithms such as branch and bound. Balas and Mazzola pro- 
posed a small-size linearization [2] and then successfully applied it to devise exact or heuristic 
cutting plane algorithms. 

In this article, we focus on new small-size tight linearizations. We first propose a primal 
version of Balas and Mazzola linearization (BML). By strengthening the linearization and then 
considering the dual model, we obtain a new linearization which improves BML. As a direct 
application, a new cutting plane algorithm is proposed. 

This article is organized as follows. In section 2, we discuss Balas and Mazzola linearization 
(BML) [2] and the related primal linearization. In section 3, we create a new approach to 
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obtain a tighter linearization. It improves the primal linearization of BML in the sense that 
the linear programming relaxation often give tighter lower bound. In section 4, we apply this 
dual linearization to devise cutting plane algorithm and compare the efficacy with that of BML. 
Concluding remarks are made in section 5. 



2 The Primal Model of Balas and Mazzola Linearization 

In this section, we show that Balas and Mazzola Linearization has a primal model. 
Define a column vector u with components 

Ui = max{^^ hjXj ■ X £ ^}) « = 1, • • • , n, (2.1) 

where X is any suitable relaxation of X such that the problems ()2.ip can be solved relatively 
easily. 

We rewrite the objective function of (P) as 



i=l j^i 



Introducing n continuous variables 



Vi := Xi'^bijXj, (2.2) 



we can obtain the following mixed 0-1 linear program 

min Y2i=i Vi + Cja^i 
^^"^^^ y.>0,^ = l,...,n, ^^-'^ 

X e X, 

where the two series inequality constraints follow from the fact (xj — ^)i^j^ibijXj — Ui) > 
and Xi > 0, bij > 0, respectively. 

Theorem 2.1. Problems (P) and (PLi) are equivalent in the sense that for each optimal 
solution to one problem, there exists an optimal solution to the other problem having the same 
optimal objective value. 

The proof is found in Appendix lAl 

Remark 2.1. If we restrict (P) as the quadratic assignment problem, the proposed linearization 
(PLi) reduces to Kaufman-Broeckx linearization 

Below we apply Benders' decomposition approach to Problem (P), as in [3]. Firstly, (P) can 
be decomposed in the following way 

71 71 

mill V + V QxJ, (2.4) 

xGX y&ix) ^-—^ 

1=1 1=1 
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where 

Y{x) := {y G > ^ kjXj + UjXj - Ui, yi>0, i = 1, 2, ...n}. (2.5) 

For fixed x, we dualize the first series constraints of the problem mmy^Y{x) X^iLi Vi using 
Lagrangian multipliers Aj (i = 1,2, ...n). We obtain the subproblem 

qp(^^ . max Er=i(EjVi ^ij^^j " u, + UiXi)Ai 

"^^^^^^ s.t. 0<Xi<l, i,j = 1,2,... n. ^^-^^ 

Note that the feasible solution region F of SP(x) does not depend on the chosen vector x. Let A* 
be the incidence vectors of the extreme points of F (which is unit hypercube in JR"). Introducing 

n 

/3^*^ :=E^S*^^^ ' i = l,2,...,2" :=T, (2.8) 



n 
i=l 

we can see that Problem (j2.4p is equivalent to 

n 

J*) 



min max {S^ a^' Xi - B^^H + axi, (2.9) 

— i=l i=l 

by the fact that for any fixed x, the second-stage problem min^^gy^^) Z^ILi y« °^ (|2.4|) is a linear 
programming whose dual formulation is just (|2.6p and the fact that one of the optimal solutions 
to the linear programming problem (j2.6|) is attained at an extreme point of F . Problem (|2.9|) 
yields now the following mixed 0-1 linear program 

min z + Y2=\ ^i^i 
(DLi) : s.t. z > X:r=i af^Xi - /jW, 1 < i < T, (2.10) 

xex. 

In some sense, linearization [DLi) can be regarded as the dual formulation of (PLl). Above we 
also obtained the equivalence between (PLi) and (DLi): 

Theorem 2.2. Problems (PLi) and (DLi) are equivalent in the sense that for each optimal 
solution to one problem, there exists an optimal solution to the other problem having the same 
optimal objective value. 

Combining Theorem 12 . 1 1 with Theorem l2.2l we can see [DLi) is equivalent to (P). In literature, 
linearization (DLi) is known as Balas and Mazzola linearization (BML) [2]. 

3 New Tight Primal and Dual Linearizations 

In this section, we propose a new approach to establish new tight linearizations. 
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Define 

Vi = max{y~^ bijXj : x G X, Xi = 0}, i = 1, . . . ,n, (3.1) 
li = min{y~^ ^ijXj '■ X € X, = 1}, i = 1, . . . , n. (3.2) 

Let V and / be the vectors with components Vi and li respectively, i = 1, . . . ,n. 
Lemma 3.1 ([E]). Let x & X <^ {0,1}". For aUi = l,...,n, 

Xi ^ bijXj = maxjy^ b^xj + ViXi - Vi, kxi}. (3.3) 

Therefore, the new Hnearization reads 

min Yli=i Vi + (^i^i 

Vi ^ li^i^ i — 1, ?1. 

X £ X, 

Under the Hnear transformations ti := yi — liXi, i = 1, . . . , n, the above Hnearization becomes 

min Y17=i *i + i^i + 
™ t,>0, z = l,...,n, (^-^^ 

As a corollary of Lemma 13. H we have 

Theorem 3.1. Problems (PL2) (or (PL'2)) and (P) are equivalent in the sense that for each 
optimal solution to one problem, there exists an optimal solution to the other problem having the 
same optimal objective value. 

Continuously relaxing linearizations (PLi) and (PL2), i.e., replacing X with X, we obtain 
linear programming lower bounds for (P), denoted by v{R-PLl) and v{R-PL2) respectively. 
{PL2) is not weaker than (PLi) in the following sense. 

Theorem 3.2. v{R-PLi) < v{R-PL2). 

Proof. It is sufficient to show any feasible solution of {PL2) is also feasible in (PLi), which 
follows from the fact that Vi < Ui, Xi £ [0, 1] and k >0 since B = (bij) is nonnegative. □ 

Next, we consider the dual model of {PL2). As the formulation of {PL'2) is similar to that of 
(PLi), we immediately have the dual model based on {DL2). 

min z + YJi^^{li + Ci)xi 

{DL2): s.t. z>Er=i«f^«-^^*^ l<^<r' (3.6) 
X £ X, 
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where 

af^ :=Y^xf)b,, + xf\v,-k), (3.7) 

n 

-f^.= Y.>^v.. (3.8) 

i=l 

Similarly to Theorem 12. 2t we have 

Theorem 3.3. Problems (PL2) (or (PL'2) ) and (DL2) are equivalent in the sense that for each 
optimal solution to one problem, there exists an optimal solution to the other problem having the 
same optimal objective value. 



4 Cutting Plane Algorithms Based on Dual Linearizations 

We first establish cutting plane algorithm based on (DLi). As in any decomposition approach 
the master problem (DLi) is not solved for all restrictions z > Yl^=i o^f^^i ~ (1 < i < T), 
but only for a subset {t\ 1 < t < r} of indices. We denote the restricted master problem by 

Getting a solution x for the restricted master problem, the subproblem SP(x) is solved, which 
yields 

Af+'^=Si, i,j = l,2,...n. (4.1) 

^(^+1) is an optimal solution of the subproblem SP(x) because of the definition of the constants 
Ui and the constraints < Aj < 1. 

A new cut 

n 

z>Y^at'^x,-p(^+'^ (4.2) 

i=l 

is added to the current {DLi~). Thus we get {DLi'^^). 

The objection function value 1 of SP{x) is an upper bound for (P), whereas the objective 
function value z_ of the master problem {DLi') is a lower bound. If z = z, stop and return an 
optimal solution. 

This is the fiow of cutting plane algorithm. Below we show the finite convergence. The proof 
is found in Appendix [Bl 

Lemma 4.1. Assume that x is an optimal solution of {DLi') and A^*"^"*^^ := Xj. For any s > r, 
X cannot be an optimal solution of (DLi^) unless it is the optimal solution of (P). 

From the above lemma, we have the convergence result proved in Appendix [Ul 

Theorem 4.1. The above cutting plane algorithm stops in a finite number of steps and returns 
the optimal solution of (P). 
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Cutting plane algorithm based on {DL2) can be similarly devised. To compare with {DLi) 
conveniently, instead of (DL2), we use the following equivalent model 



min z + Y17=i '^i^i 

{DL'2) : s.t. Z > Er=l(«f^ + ^^)^^ - l<t<T., 



(4.3) 



xeX. 



Theorem 4.2. Assume li > for all i = l,2,...,n. The restricted master program [DL2'') 
gives a lower hound strictly better than that of {DLi') until the cutting plane algorithm stops. 

5 Conclusions 

In this article, we focus on the generalized quadratic 0-1 program, denoted by (P). We propose a 
linearization {PLi) for (P) and show that it can be regarded as a dual formulation of Balas and 
Mazzola linearization (BML), denoted (DLi). By applying a new approach, we establish a tight 
linearization {PL2) of the same size. We proved {PL2) is not weaker than (PLi) in the sense 
that the continuous linear programming relaxation of {PL2) gives tighter lower bound than that 
of (PLi). The dual linearizations of {PLi) and (PL2), {DLi) and {DL2) are successfully used 
in devising cutting plane algorithms, respectively. We showed that the cutting plane algorithm 
based on {DL2) is strictly better than that of [DLi) under some weak assumptions. 

A Proof of Theorem 12.11 : 

Let X be any feasible solution to (P). It is easy to verify that is feasible in (PLi) with 

the same objective value, where yi = XiYlj^^ibijXj. As a consequence, the optimal objective 
value of {PLi) gives a lower bound for (P). It is sufficient to show that if is an optimal 

solution to (PLi), x* is optimal in (P) with the same objective value. We notice that y* = 
max{E^y . bijX* + UiX* - Ui,0}. If x* = 1, we have y* = J2jj^i bijX*, otherwise, x* = 0, y* = 0. 
As a conclusion, y* = x*{J2j^ibijX*) which implies Z^Li ^/j* = 121=1 ^iCEj^ibijX*). That is, 
X* is a feasible solution to (P) whose objective value equals a lower bound. Therefore, x* is 
optimal in (P) and both the optimal objective values are equal. □ 

B Proof of Lemma 14.11 : 

Denote the optimal objective function value of any master problem (DLi^) by Zg, which is a 
lower bound for (P). If x is also an optimal solution of (DLi^) for some s > r, it follows that 



since {DL\^) contains the constraint (j4.2p . The left-hand side of (jB.ip is a lower bound for (P) 
while the right-hand side of (jB.ip corresponds to a feasible objective function value of (P), which 



n 




(B.l) 



i=l 
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can be shown as follows: 



n 



i=l 

n n 

i=l jj^i 2=1 
n n 

i=l j^i 1=1 



— bjiXj)xi. 

i=l j^i 

Therefore (jB.ip holds as equality and x must be the optimal solution of (P). □ 



C Proof of Theorem 14.2 



If the cutting plane algorithm based on {DL'2) has not stopped at step r, the optimal solution x 
must be different from A^*^ for any 1 < t < r, i.e., there exist index it such that (1 — xf^)xi^ > 0. 
Then the right-hand side of {DL2^') satisfies 



i=l 



1=1 j^i i=l 
n n n 

^ E(E ^f^^^ + \^*^^^)^^ - E ^f""^ + E ^'^(1 - ^)^- 

i=l jT^i 1=1 1=1 

n n 

> EE + ^f^^*)^^ - E (c.i) 

1=1 j^i 1=1 

for any 1 < t < r. Therefore the objective function value of {DL2^') is strictly larger than that 
ofpLi'). □ 
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